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ABSTRACT 

In New York State, strengthening of its evaluation 
of educational provision was started with the Elementary and 
Secondary Education Act Title III; review and training sessions, paid 
for out of Title III funds, were provided over a three-month period 
ending in February 1969 for evaluators from the 16 regional centers. 
This report on educational objectives is one of six summaries of the 
sessions. Discussion centered first on the role of the evaluator in 
describing and appraising educational procedures and results, on 
evaluation as the process of relating facts to values, on evaluation 
and educational change, and finally on general criteria for a pproval 
of Title III proposals. The n followed discussion of Nev/ York State's 
educational goals and needs; a taxonomy of educational objectives was 
provided and a listing of objectives proposed by various bureaus of 
the State Department of Education. Finally exercises were given which 
provided practice in classifying objectives, marking inconsistencies, 
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FOREWORD 



The Increased competition for the tax dollar has caused and will 
continue to cause more rigorous evaluations In all fields of education, 
particularly at the Federal level. Increasingly, legislators and their 
constituent taxpayers are demanding hard data which will Indicate whether a 
costly program Is achieving that which It has purported to achieve. Under 
these conditions evaluation at all levels must satisfy the criteria elements 
of significance, credibility, and timeliness. Within this framework evalua- 
tive techniques must be strengthened. 

Appropriate departmental personnel believed that strengthening the 
evaluative effort of the State might start with the Elementary and Secondary 
Education Act (ESEA) In general and Title III of that Act In particular. Fur- 
ther, that the 16 existing Regional Centers contained evaluators who might be 
In a strategic position to disseminate the Information gained through a work- 
shop approach. 

Leo D. Doherty, Supervisor of Education Research, of the Division of 
Evaluation was asked to organize some review and training sessions appropriate 
for the task. He selected people from within the State to prepare and conduct 
formal lessons accompanied by simulated experiences and relaced materials. 

This document Is one In a series of six summaries of sessions completed In a 
3-month period terminating In February 1969. 

While the sessions were paid for out of Title III funds, the contents 
are appropriate for use with other Titles such as I, or other large program 
evaluative problems such as those encountered In N.D.E.A., Title III, Urban 
Education, or the like. 

This document on Determining Objectives was prepared by Maurltz Johnson, 
State University of New York at Albany.. 
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INTRODUCTION 

A new role is emerging in education, that of the evaluator . Not that 
of an administrator, not that of a teacher, not exactly that of a researcher, 
the evaluator's role is one of describing and appraising educational procedures 
and results. The researcher often engages in evaluation, but his purpose is 
to test hypotheses to generate new knowledge. Administrators and teachers 
engage in evaluation, but their purposes are to obtain data on which to base 
decisions affecting students, and to determine the effectiveness of programs 
and procedures for which they are responsible. The evaluator, on the other 
hand, may or may not be interested in testing hypotheses and may or may not 
be responsible for the program being evaluated. His interest is in determining, 
as accurately as possible, what took place in a given educational situation and 
what resulted from it. 

Title III of the Elementary and Secondary Education Act of 1965 has 
provided a setting for the elaboration and establishment of the role of 
evaluation. Evaluation is central in Title III>, The Act itself (P.L. 89-10) 
includes an evaluation requirement: 

".«.t*o determine the extent to which funds provided 
under this Title have been effective in Improving 
the educational opportunities of persons in the 
area served.” 

The statement indicates that the purpose of the Title is to improve 
educational opportunity. This can be done in two ways: 

1. Increase opportunity — by making more education 
and more kinds of educational opportunity available 
and by making it available to more people. 

2. Improve education — by making the education for 
which opportunities are made available more effective. 



The objectives of Title III in achieving this purpose are: 
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1, Innovation -- developing new solutions to 
educational problems. 

2. Exemplification - demonstrating In a new setting 
promising solutions developed elsewhere. 

New York’s State Plan^ for Title III provides for an organizational 
structure that reflects the centrality of evaluation. The Center on Innova- 
tion (COIN) coordinates innovative activities both within the State Education 
Department and throughout the State. One of the three components of COIN 
(Chart 1) Is an Evaluation Unit and each of the 16 regional centers Includes 
an evaluator on Its staff. 

EVALUATION 

Evaluation involves relating facts to values. Facts are essential for 
evaluation and so are values, but neither alone Is sufficient. Evaluation is 
partly objective and partly sub jee wive. 

An evaluation model aids understanding. The specifics vary in different 
evaluative situations, but they can be fitted Into a model. 

Stake^ has pointed out that evaluation not only has a descriptive and 
a judgmental aspect, but also that it is concerned with three aspects of a 
program: the antecedents or Inputs, the transactions or process, and the out- 

comes or product. His evaluation matrix (Chart 2) provides for recording, for 
each of these three aspects, descriptive data relating to what is Intended by 
way of Inputs, process, and product (Intents) and what is actually observed 
with respect to each (observations). In most educational situations, however, 
as in most other human endeavors, actualities seldom correspond exactly with 
intentions. It is necessary in the judgment matrix to first specify the degree 
of correspondence that is acceptable (general standards) and then to indicate 
whether, or to what extent, the standards were in fact met (specific judgments). 

iNew York State Plan, Title III, ESEA, Albany: State Education Department, 

1968. Sec. 2. 2.1. a 

^Robert Stake, The Countenance of Educational Evaluation, Urbana: University 

of Illinois Center for Instructional Research and Curriculum Evaluation, 

1966 (Mimeo) 

o 
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Chart #2 
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When a single program is involved, the standards are absolute in nature; 
when there are two or more, the standards are usually comparative . Evaluation 
of a systematic sort may occur during the course of the program. This formative 
evaluation provides a basis for Improving procedures or revising materials which 
cannot be done when the summative evaluation occurs upon completion of the pro- 
gram. Its purpose is to provide other potential users with a basis for decision- 
making. 

Whether the evaluation is formative or summative. Stake asserts, it is 
as undesirable for an evaluator to avoid making judgments on the basis of the 
facts as it is to make judgments in the absence of the facts. In addition to 
the contingencies between intents and observations, which are the basic matters 
for judgment, there are usually, as Stake has Indicated (Chart 3) some contin- 
gencies among intents that can be logically expected and empirically tested. 

These contingencies are relationships between certain transactions and certain 
antecedents or certain outcomes. Thus, when a program on the whole does not 
appear effective, some of the procedures may be shown to be highly successful 
in achieving some of the desired results with some of the pupils under som ;:: 
circumstances, or vice versa for an overall effective program. 

The CIPP model (Chart 4) developed by Stufflebeam^ uses different ter- 
minology, but Includes the same three program aspects as Stake's. In effect, 
however, it distinguishes two kinds of antecedent: context factors and inputs . 

The context consists of the setting in which the program functions and goals 
the program seeks to achieve. The inputs are the elements which enter into 
the transactions: the plans which guide the process and the resources for 















1 

1 
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carrying it out. 



^Daniel Stufflebeam, *'The Use and Abuse of Evaluation in Title III” Theory 
into Practice, 6 (June 1967), p. 132. 
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Both of these models call attention to the scope of evaluation. Two 
other models may help to put evaluation Into educational perspective. One, 
by Johnson,^ focuses on curriculum and Instruction, the heart of the education 
enterprise (Chart 5). In It, curriculum Is viewed as a structured series of 
Intended learning outcomes, which are selected from the total available and 
teachable cultural content, and which serve as a guide to Instruction and as 
a basis for evaluation of Its product. Evaluation here Is seen as a comparison 
between Intended and actual outcomes. 

In the larger context of the school system as a subsystem of the 
community, evaluation Involves a comparison between the demands placed upon 
the subsystem by the larger social system and the outputs from the subsystem 
into the larger system. This administrative model, based on the work of R. J. 
Hllls^ depicts (Chart 6) a process whereby resources are procured and allocated, 
along with demands, to appropriate subsystems where educational outputs are 
created for Integration Into the higher systems and evaluated against demands. 
EVALUATION AND EDUCATIONAL CHANGE 

Since Title III Is concerned with effecting educational change, an 
overall view of the distinct but related processes Involved in change Is 
useful. Perhaps the best known model is that of Cuba and Clark^. Title III 
activities encompass three phases, namely, development , diffusion , and the 
trial stage In adoption (Table 1). Development and trial both entail evalua- 
tion aimed at giving direction to the inventive process and to the decision 

%auritz Johnson, "Definitions and Models in Curriculum Theory" Educational 
Theory , 17 (April, 1967), pp. 127-140. 

5r. Jean Hills, "The Representative Function: Neglected Dimension of Leader- 

ship Behavior," Administrative Science Quarterly , 8 (June, 1963), pp. 83-101. 

^Egon Cuba & David Clark, "An Examination of Potential Change Roles in 
Education" in Rational Planning In Curriculum and Instruction , Washington: 
National Education Association, Center for the Study of Instruction, 1967, 

p. 116. 










chon t(5 

CURRICULUM-INSTRUCTION MODEL 




i 



1 

i 











T 



- 10 - 

Chort #6 
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Table «1 
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concerning Installation. Diffusion, too, implies evaluated innovations to 
be disseminated. 

The linearity of this model suggests (though its authors do not) that, 
whenever educational change occurs, the three phases in question must have 
preceded it and must in turn, have been based on and precipitated by research. 

To avoid this impression, Gideonse^ proposed a model depicting three levels, 
operations , development , and research , shown as planes in Chart 7 . At any 
of these levels, activities may be initiated which may lead to change at the 
level of operations and which may or may not entail a demand for initiative 
at another (lower) level. 

Aside from its position on some continuum of educational change activity, 
evaluation in the context of Title III may be seen as occurring at four levels : 
prdjdct, local (regional center), state, and national. Evaluative data at any 
level Inform decision-making regarding the desirability of continuation or 
revision of programs, and (except at the national level), when communicated 
to the next higher level, serve as bases for evaluating the total effort at 

I 

[ ■ that level* The resulting "feedback control loops" have been depicted by 

Stufflebeam® (Chart 8). 

PROJECT EVALUATION 

Projects can be evaluated at three points in time: first, as a 

proposal ; second, as a process j and third, as a product . Criteria for evalua- 

: 

ting proposals are presented in the Federal guidelines for Title III. The 
New York State Plan includes 13 such criteria, adapted from the Federal guide- 
linevS* They are summarized in Table 2. Criterion 12 refers specifically to 
evaluation . Criteria 1 and 2 pertain to objectives . (Table 3)« 



^Hendrik Gideonse, "Research, Development, and the Improvement of Education" 
Science, 162, (November, 1968), pp. 541-45. 




®Daniel Stufflebeam, o£, cit . , p. 130. 
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Chart #7 
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Table 2 
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General Criteria for Approval 
of Title III Proposals 



1. Adequacy of the statement of needs and objectives. 

2. Significance of the problem In relation to the critical needs of education 
In the State as determined by the Board of Regents. 

3. Adequacy of the solution for solving the problem posed. Including evidence 
of adequate planning and awareness of relevant research, alternative 
solutions, and similar programs. 

4. The probability that the solution. If successful, can be adopted by others 
with similar problems; this Implies that the cost of the solution shall 
bear a reasonable relation to the personnel, facilities, and funds which 
might be generally available for Implementation. 

5. Availability and competency of the personnel to Implement the project; 
suitability of the size and qualifications of the staff proposed; extent 
to which the best available talent and resources will be utilized to 
substantially Increase the educational opportunities of children to be 
served by the project. 

6. Adequacy and appropriateness of the facilities, equipment, and materials 
to be used In the proposed project. 

7. Adequacy of the evidence that the funds for the proposed project will 
supplement and not supplant local and State funds. 

8. Extent to which the program is innovative in that it presents a new or 
Improved educational Idea, practice, or technique; or extent to which the 
program is exemplary in that the activity is designed to serve as a model 
for regular school programs. 

9. Evidence of the willingness of the district to contribute to the support 
of the project If It proves successful, and. If Initial local support is 
indicated, that the commitment Is officially made. 

10. Adequacy of documentation showing the extent of the involvement in planning 
and Implementing project activities of teachers, students, or other school 
personnel and others. Including those with low Income, broadly representative 
of the cultural and educational resources and of the public In the area to 

be served. 

11. Extent to which the proposed project will appropriately Involve children In 
private nonprofit schools. 



'i 

i 

I 

I 

I 

j 

j 



12. Extent to which provisions for evaluating the proposed project are 

appropriate and adequate and provide for a reasonable degree of objectivity. 



13. Extent to which provisions for dissemination of Information about the 

proposed program are appropriate and adequate for the area to be served. 
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Table 3 



Summary and Classification 
of Title III 



PROPOSAL CRITERIiV 
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Objectives:. 






Statement adequacy (1) 
priority (2) 



Procedures : 

‘ ' supplementary (7) 

general adoptability (4) 
irinovative or exemplary (8) 
appropriateness 
' adequacy (3) 

awareness of alternatives (3) 

. ■ ■ ■ wide involvement (10) 
planning (3) 
support prospect (9) 

, notl-private pupil involvement (11) 
' . . dissemination (13) 

staff (5) 

facilities (6) 
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Evaluation ; 

appropriateness (12) 
. adequacy (12) 
objectivity (12) 
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The process of executing a project can be evaluated by determining 
whether planned activities are actually being carried out, whether the 
schedule is being maintained, and to some extent, how competently the proce- 
dures are being performed, in terms of what was intended. Evaluation always 
involves a comparison of actualities with intentions, expectations, or promises. 

Ultimately, projects must be evaluated in terms of results. This in- 
volves treatment evaluation. It is important to recognize that the objectives 
of a project can be successfully achieved even though the results of the 
treatment are unsatisfactory. A major difference between research projects 
and development (or demonstration) projects should also be recognized. In 
research, the treatment cannot be altered while in progress. In development, 
it may well be appropriate to modify procedures or materials on the basis of 
formative evaluation. 

In the long range strategy adopted by New York State for systematically 
effecting educational improvement through Title 111 and other mechanisms, the 
evaluation of solutions is the fifth out of seven steps which may be summarized 
as follows: 






i: 

I 

F, 

1 ; . 






1 . 



2 . 



3. 



4. 



5. 



6 . 



7. 



Assess needs 
Define problems 
Design solutions 
Implement pilot tests 
Evaluate solutions 
Disseminate results 
Demonstrate solutions 



It is obvious that evaluation is also central in three of the remaining 
six steps, namely the assessing of needs, pilot testing, and demonstrating 
solutions. The terminology here needs to be clearly understood. A goal is 



defined as a desired state of affairs. A baseline is an existing state of 
affairs. The discrepancy between a goal and the corresponding baseline is 
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a need. Thus, N « G - B. A problem is an obstacle to meeting a need, or 
achieving a goal. A solution is a series of activities designed to remove an 
obstacle, to solve a problem, to meet a need, or achieve a goal. The effe c tiv e- 
ness of a solution is the extent to which the discrepancy between the baseline 
and the goal is reduced (Chart 9) • 

Goals, and hence needs, can be expressed at various levels of generality. 
The educational goals and needs of New York State, as adopted by the Board of 
Regents, are necessarily general. (Tables 4 and 5). They indicate broad areas 
of priority in relation to which specific needs are recognized and the signifi- 
cance of specific problems is judged. Under Title III the limited resources 
for support of improvement activities are allocated to finding solutions for 
the most serious problems, the most pressing needs, and the most important goals. 
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Table 4 



STATE'S EDUCATIONAL GOALS 



Assure each Individual opportunity for sufficient formal education 

to enable him to: 

(1) develop skills and attitudes and acquire knowledge necessary 
for successful functioning as an Individual and In society; 

(2) make constructive choices regarding future education and to 
advance to and profit from occupational training and/or 
advanced academic and professional education; 

(3) take advantage of continuing educational opportunity outside 
formal educational system; 

(4) benefit from use of cultural resources; 

(5) enjoy an Intellectually and emotionally rich and productive life. 
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Table 5 



STATE'S GENERAL EDUCATIONAL NEEDS 



Improvements and revision In: 

1. Development of general skills, knowledge, attitudes 



1.6 State aid 

2. Development of occupational skills and attitudes 

2.1 City youth and adults 

2.2 Area vocational schools 

2.3 Expanded BOCES programs 

3. Development of advanced academic and professional skills 

3.1 Regents master plan 

3.2 Student financial aid 

3.3 Aid for private higher education 

4. Development of cultural resources 

4.1 Statewide library system 

4.2 NYS cultural center 

4.3 Educational media 

5. Vocational rehabilitation 



1 . 1 Urban 

1 . 2 Prekindergarten 

1.3 Integration 

1.4 NYC decentralization 

1 . 5 Summer programs 



1.7 School district reorganization 

1.8 Model educational patterns 

1.9 Instructional technology 

1.10 Employment relations 

1.11 Teacher recruitment, training 



5.1 Individual services 

5.2 Community resources 



6. Administration of State Education Department 
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OBJECTIVES 



Clearly no solution can be devised, no program designed, no procedures 
carried out without objectives* The objectives may not be explicitly stated 
and may not even be recognized, but some objective must be implicit. Before 
an Idea for a solution can be completely developed and before a solution can 
be evaluated, all of the objectives must be Identified and made explicit. 

When developera have failed to state objectives, evaluators must do so. They 
should be stated prior to the development* in any event, they must be stated 
in terms which permit evaluation. 

This training program has objectives. The program deals with six 

topics: 

1. Determining objectives 

2. Designing solutions (tasks) 

3. Gathering data 

4. Sources and control of variability 

5. Designs for evaluation 

6. Presenting proposals and reports 

Four main kinds of ability should result from participation in the 
training program. These are its objectives: 

1. Ability to formulate and criticize OBJECTIVES 

2. Ability to devise and select SOLUTIONS 

3. Ability to design and execute EVALUATION 

4. Ability to prepare PROPOSALS and REPORTS 

Specific objectives are associated with each topic. Under the present 
topic, objectives, the following objectives may be identified: 

Overall Objective: 

To develop increased understanding and competence regarding the 
formulation of project objectives and activities 



Specific Objectives: 
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1. Understanding of: 

Educational goals 
Priorities In educational needs 

* Significant educational problems 

Relation of project objectives to project activities 
and evaluation 

2. Competence In: 

Criticizing statements of objectives 
Writing clear statements of objectives 

There are, with respect to any Title III project, two classes of 
objectives. The relationship between them resembles that between a story- 
wlthln-a -story and the story Itself. That Is, the project Itself, as a 
whole, has certain objectives, and the treatment Incorporated In the project 
has Its objectives. The treatment objectives are usually educational In 
nature and concern some kind of learning or behavior change to be effected. 
The objectives of any project, on the other hand, are to design, execute, 
and evaluate a treatment. 

EDUCATIONAL OBJECTIVES 

Educational objectives are expressed as potential outcomes of the 
learning process or as desired conditions for facilitating that process. 

The latter are Instrumental objectives and refer to Improved procedures, 
contextual features, or personnel competencies. The former are goal- 
oriented objectives, which have reference to things that can be learned, as 
a direct result of Instruction, or Indirectly as a result of certain environ- 
mental conditions. These educational objectives should be distinguished from 
societal goals relating to education. Ability to read Is an educational 
objective; reducing the dropout rate Is a societal objective. Table 6 
shows the major classes of societal and educational objectives. 

Society Is concerned with the quality of education both In the sense 

t eric 
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that more important educational objectives are not being neglected in favor 
of less important ones and in the sense that important goals are effectively 
being achieved. There is a societal concern for quantity , both with respect 
I to the numbers of students to be educated and the increasing amount of know- 

I ledge to be transmitted. Some societal problems relate to providing equality 

I of educational opportunity, regardless of location or socioeconomic status. 

The efficiency of the education enterprise with respect to amount accomplished 
both per dollar and per unit of time is also an ever present societal concern. 

Goal "Oriented educational objectives consist of the development of 
skills and of cognitive and evaluative maps; that is, skills, understandings, 
and attitudes. Some skills are components of the cognitive domain^, whereas 
others belong in the psychomotor domain. The cognitive domain also includes 
knowledge or understandings, while attitudes or valuative maps represent the 
affective domain^®. (Table 7). 

Learning outcomes may also be classified according to use. Some are 
used in the form in which learned (replicatively) , some are used even though 
details are forgotten (associatively) , some are used in solving problems 
(applicatively) , and some are used to give meaning to subsequent experiences 
(interpretively) . The range of possible educational objectives includes 
those primarily serving vocational purposes, those which pertain to the 
responsibilities of citizenship, and those which contribute to self-cultivation. 



s. Bloom et al . Taxonomy of Educational Objectives , I -Cognitive Domain, 
Longmans, Green, 1956. 

R. Krathwuhl et al. Taxonomy of Educational Objectives . II-Affective 

[ Domain, David McKay, 1964. 

^^Harry Broudy, B. 0. Smith, 6e Joe Burnett, Democracy and Excellence jja 
American Secondary Education , Rand, McNally, 1964. 
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Table 7 



TAXONOMY OF EDUCATIONAL OBJECTIVES 
COGNITIVE DOMAInI^ 



1.00 knowledge 

1.10 Specifics 

1.11 Terminology 
Ik 12 Specific facts 

1.20 ways and Means of Dealing with Specifics 

1.21 Conventions 

1.22 Trends and sequences 

1.23 Classifications and categories 
1^24 Cirlterla 

1.25 Methodology 

1.30 Uhlversals and Abstractions In a Field 

I 

1.31 Principles and generalizations 

1.32 Theories and structures 

2.00 COMPEEmSXON 
2.16 Translation 

2.20 Interpretation 

2.30 Exti^apolation 

3.00 APPLICATION 

4.00 ANALYSIS 

4.10 Elements 

4.20 Relationships 

4*30 Otganlisatlonal principles 

5.00 synthesis 

5.10 Production of unique communication 

5.20 Production of plan or proposed set of operations 

5.30 Derivation of set of abstract relations 

6.00 EVALUATION 

6.10 In terms of internal evidence 

6.20 In terms of external criteria 



1/ S. Bloom et al . , Taxonomy of Educational Objectives , Handbook I: 
Cognitive Domain^ Longmans, Green, 1956, pp. 201-207. Also: 

D. R. Krathwohl et al . , Taxonomy of Educational Objectives , Handbook II: 
Affective Domain, David McKay Company, 1964, pp. 186-193. 
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Table 7 (Continued) 

2 / 

AFFECTIVE DOMAIN^' 



■ 

: 



1 . 0 RECEIVING (ATTENDING) 

1.1 Awareness 

1.2 Willingness to receive 

1.3 Controlled or selected attention 

2.0 RESPONDING 

2.1 Acquiescence in responding 

2.2 Willingness to respond 

2.3 Satisfaction in response 

3 . 0 VALUING 

3.1 Acceptance of a value 

3.2 Preference for a value 

3.3 Commitment 

4.0 ORGANIZATION 

4.1 Conceptualization of a value 

4.2 Organization of a value system 

5.0 CHARACTERIZATION BY A VALUE OR VALUE COMPLEX 

5.1 Generalized set 

5.2 Characterization 






I 



Krathwohl, op. cit . . pp. 185-186. 
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Table 7 (Continued) 
PSYCHOMOTOR DOMAIN^/ 



1.0 PERCEPTION 

1.1 Sensory stimulation 

1.11 Auditory 

1.12 Visual 

1.13 Tactile 

1.14 Taste 

1.15 Smell 

1.16 Kinesthetic 
1*2 Cue selection 
1.3 Translation 

2.0 SET 

2.1 Mental set 

2.2 physical set 

2.3 Emotional set 

3.0 GUIDED RESPONSE 

3.1 Imitation 

3.2 Trial and error 

4.0 MECHANISM 

5.0 COMPLEX OVERT RESPONSE 

5.1 Resolution of uncertainty 

5.2 Automatic performance 



PSYCHOMOTOR DOMAIN^/ 



1.00 Initiatory Level of Execution 

2.00 Preroutine Level of Execution 

2.10 Nonadaptive 

2.20 Adaptive 

3.00 Routinized Level of Execution 

3.10 Nonadaptive 

3.20 Adaptive 



1/Elizabeth Simpson, The Classification of Educational Objectives, 
Psychomotor Domain, University of Illinois — USOE Vocational and 
Technical Education Grant Contract No. OE 5-85-104. 

^/jinapala Alles, ”An Outline Analysis of Psycho-motor Aspects of 
~ Behavior," Theoretical Constructs ija Curriculum Development and 
Evaluation it Ministry of Education, Ceylon, 1967. 
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chart 10 provides a classification of societal and educational 
objectives In the tabular chart form used In the Program Evaluation and 
Review Technique commonly known as PERT. 

STATING OBJECTIVES 

Consistent language Is difficult In expressing objectives. Some 
lists mix societal and educational objectives Indiscriminately. Some shift 
from one level of specificity to another. (Table 8). It should be recognized 
that there are three levels which are relative to each other: values, ends, 

and means. In general, objectives are ends sought, something to be accomplished . 
The means consist In what Is done to Implement the objective, to bring about 
the desired accomplishments. Values provide the justification for attempting 
to bring about the accomplishment, to justify the objectives. In general, 
objectives deal with the question of what result Is Intended, whereas values 
deal with why , and means with how . But there is a hierarchy of values, such 
that all but the highest Is Itself justified by a higher one. And there Is a 
hierarchy of means, such that all but the lowest are ends achieved through 
lower means. 

In any given situation the objectives should be expressed In terms of 

what Is to be learned , not what activities are to be engaged In, or what 

12 

ultimate purpose that which Is learned Is to serve, Mager has stipulated that 
for evaluative purposes Instructional objectives should be so stated as to 
make clear three things: 

(1) What performance Is learner to be expected to 
display ( DO what?) 

(2) Under what conditions he will be expected to display 
it ( GIVEN what?) 

(3) What standards the performance will be required to meet 
(How WELL , e.g., in terms of speed, accuracy, proportion 
correct, deviation tolerance, etc.) 

1^ Robert Mager, Preparing Objectives for Programmed Instruction , Fearon, 1961 



Chart «10 



Tobulor Taxonomy of Objoctivos 
(PERT) 





L«v«l 1 


Lovol 2 


Lovol 3 


Laval 4 


Ob|«ctlv«t 


1. 

Socittal 


1 . 1 . 

Quolity 

1.2. 

Quontity 

1.3. 

Equality 

1.4. 

Efficiancy 






2. 

Educational 

1 


2.1. 

Gool-ori«nt«d 


2.11. 

Initructional 


2.111. 

Substontiva 

2.112. 

Procati 

2.113. 

Affactiva 


2,12. 

Non-instruttionai 




2.2. 

Instrumantol 


2.21. 

Procadural 

2.22. 

Contaxtual 

2.23. 

Parsonal 
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1 . 
2 . 

3 . 

4 . 

5 . 

6 . 

7 . 

8 . 
9 . 

10 . 
11 . 
12 . 

13 . 

14 . 

15 . 

16 . 

17 . 

18 . 

19 . 

20 . 
21 . 

22 . 

23 . 

24 . 

25 . 

26 . 

27 . 

28 . 

29 . 

30 . 

31 . 

32 . 

33 . 

34 . 
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Table 8 

SOME OBJECTIVES PROPOSED BY 
VARIOUS BUREAUS OB' STATE EDUCATION DEPARTMENT 



Increase In use of audio recordlnfss In Instruction and learning. 

Increase students' interest In learning through the use of educational 
communications media. 

To Increase feelings of adequacy and worth. 

To enable acceptance of various roles with relation to Individuals and groups. 
To Improve computational skills. 

To Improve mathematical understanding (concepts). 

To Increase vocabulary. 

To make behavior more acceptable. 

To Improve performance on the job. 

To assist pupil In acquiring marketable skill. 

To raise occupational Interests. 

To raise pupil's opinion of self. 

To Improve muscular strength. 

To provide recreational activities that meet the needs and Interests of 
students. 

To develop skill, knowledge, and appreciation In specific arts and crafts 
activities. 

To develop social relationships through recreational activities. 

To Improve attitudes toward habits for the study of music. 

To promote greater Interest In the visual arts. 

To widen students' horizons; enable him to become more aware of our Industrial 
society. 

To provide satisfying experiences which will develop his feeling of confidence 
and self-respect. 

To encourage a philosophy of mobility of employment coupled with periodic 
retraining. 

To develop ability to prepare a simple payroll. 

To provide supervised, paid, part-time employment In an actual job situation. 

To develop and refine personality characteristics associated with salesmanship. 
To provide basic product Information needed In selling. 

To produce more conforming behavior on the part of school children. 

To Improve the holding power of schools. 

To Improve physical health. 

To provide healthful school environment. 

Development of curricula to meet Individual needs. 

To encourage earlier, more thorough evaluation of learning problems. 

To survey and Identify the needs of disadvantaged pupils. 

To Improve the organization of secondary schools. 

Adapt classroom procedures to nature of deprived children. 
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There is much controversy today concerning the necessity or even 



desirability o£ expressing instructional objectives in behavioral terms or 
even in specific nonbehavioral terms. It is possible to carry out instruction 
or design treatments on the basis of somewhat vague and general objectives, 
it is also clear, however, that to evaluate the results of that instruction 
or treatment, students must be required to perform in some observable way 
acceptable as evidence that learning has occurred, even though the instruction 
was not aimed primarily at that kind of performance. Evaluators, therefore, 
must at some point translate objectives into performance criteria reflecting 
the acquisition of some learning outcome against which terminal performance 
may be compared. 

Instrumental objectives are educational in that they refer to conditions 
within the educational setting, e.g. increased use of audiovisual aids, in- 
creased use of indirect teacher influence, increased teacher knowledge of 
latest developments in the disciplines, etc., conditions assumed to be related 
to the attainment of goal-oriented instructional objectives. Objectives which 
deal with changes in the behavior or knowledge of teachers, or other school 
personnel, are of course goal -oriented instructional objectives at another 
level, but with respect to students * learning, they are Instrumental. Whereas 
societal objectives are valid insofar as they are sanctioned by an appropriate 
body representing society or the community, instrumental objectives must be 
demonstrated to be related to the achievement of educational goals. Some 
projects are specifically designed to demonstrate the relationship between 
treatment and the achievement of instructional objectives. Where this is not 
the purpose of the project, it is essential to prove that such a relationship 
has been reliably demonstrated in the past. Whenever the objectives of a 
project are not expressed as learning outcomes, it is necessary to show that 
they are in fact instrumental to the attainment of learning outcomes. 
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In addition to the clarity with which they are stated, objectives 
should, according to Mlles^^, meet criteria of acceptance, achlevablllty, 



and appropriateness. Acceptance pertains to what Brackenbury^^ calls commit- 
ment, both Intellectual and emotional, on the part of those who are to achieve 
the objectives. Achlevablllty refers to the feasibility of trying to reach a 
particular goal In the educational setting, whereas appropriateness concerns 
whether It Is desirable to do so, even If feasible. Brackenbury adds one 
more criterion to Miles* list, namely, worth . This suggests that attention 
be given to the priority attached to the achievement of a particular objective 
in contrast with other possible goals. 

EXERCISES 

A number of abstracts of proposed Title III projects appear on the 
following pages of this report. Select a few of these at random and attempt 
to state appropriate goal-oriented objectives for each project. Vlhere the 
project does not appear to be aimed at producing any direct changes In 
students, express the objectives In Instrumental terms or. If necessary. In 



terms of specific soc5.etal goals. 

Exercises numbered 1 through 8 provide practice In classifying 
objectives, marking Inconsistencies, translating needs into problems, 
appraising the clarity and achlevablllty of stated objectives, assessing 
priorities, and writing objectives in behavioral terms. 



^%athew Miles, "Planned Change and Organizational Health," in Richard 
Carlson e^ al. , Change Processes in the Public Schools , Center for the 
Advanced Study of Educational Administration, University of Oregon, 

1965, p, 18. 

■ 

* l%obert Brackenbury, "Guidelines to Help Schools Formulate and Validate 

Objectives" in Center for Study of Instruction, Rational Planning 
Curriculum and Instruction , National Education Association, 1967, pp. 89-108. 
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Exercise 1 



Using the numbers in the Tabular Taxonomy of Objectives (Chart 10) 
classify each of the following objectives; 

Interest in classical music 

________ Improved holding power 

Enlarged vocabulary 

Knowledge of historical facts 

______ Improved test validity 

Increased use of programmed instruction 

_____ Ability to operate power tools 

Decreased racial segregation 

Improved physical fitness 

Respect for truth on part of students 

_______ More questions by students in class 

Lengthened library hours 

Skill in performing mathematical operations 

______ Understanding of scientific laws 

_______ Assistance in making vocational choice 

______ Better orientation of teachers to community 

Greater commitment to freedom by students 

_____ Grouping by aptitude in particular subjects 
_____ Better deductive reasoning 

______ Teachers r'xnpetent in use of audio-visual tools 

Improved classroom atmosphere 

_____ Increased understanding of modern math by teachers 
_____ Reduced costs of schooling per pupil 
______ Ability to get along with others 
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EKerclse 2 



1. The following three objectives were proposed for a program. 

In what sense are they Inconsistent? 

a) To recognize relationships 

b) To develop independent study skills 

c) To encourage reading for personal value and pleasure 

2. Which two of the following objectives of a single project 
are inconsistent with the others? 

a) To provide activities which will help children build 
up skills. . . 

b) To improve general motor coordination... 

c) To improve the ability to follow directions... 

d) To increase attention span. . . 

e) To insure knowledge of directionality... 

f) To provide materials which will teach proper eye movements... 

3. What definitions would you desire if confronted with the 
following project objective? 

"To design, develop, implement, evaluate, and revise as 
necessary an individualized, learner-centered * instructional 
system' which is demonstrably superior to the traditional 
instruction." 
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Exerclse 3 



Classify each of the follcs/ing test items by the type of knowledge 
being tested, (Place the number of the sub-category in front of 
each item.) (Table 7) 



Categories 
1.0 Knowledge 

1.10 Knowledge of Specifics 

1.20 Knowledge of Ways and Means of Dealing with Specifics 
1.30 Knowledge of Universals and Abstractions in a Field 



State Ohm's Law 

Give date of Battle of Waterloo 
Define sonata 

Correct this sentence: We was robbed? 

Assign the following to phyla: insects, frogs, turtles 

List the phases of mitosis 

Describe how to determine the molarity of an acid solution 
Explain the wave theory of light 

Summarize the pattern of immigration to the U. S. during the 
19th century 

Identify five characteristics of a good term paper 
Pick the best synonym for viscous: limpid, heavy, fierce 

Draw a C-sharp note on the treble clef 
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Exercise 4 



When students are learning to do each of the following things, what 
main category of the cognitive domain Is Involved? (Place number 
of category In front of each Item.) (Table 7) 



Categories 


1.0 


Knowledge 


2.0 


Comprehension 


3.0 


Application 


4.0 


Analysis 


5.0 


Synthesis 


6.0 


Evaluation 



Formulate hypotheses 

Use abstractions in particular situations 



Recognize unstated assumptions 
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Exercise ^ 

Try to Identify, for each of the following educational needs, 
as many "problems" or obstacles to meeting the needs possible: 

Need: Improve spoken language of disadvantaged students 

Problems: 



Need: Increase creativity of adolescents 

Problems : 



Need: Attain greater facility with foreign language 

Problems: 
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Exercise 6 



Rate each of the following project objectives on the criteria of clarity and 
achievability, using the following key: 





Clarity 


Achievability 


1. 


Very clear 


1. Highly likely 


2. 




2. 


3. 


Fairly clear 


3. Fairly likely 


4. 




4. 


5. 


Very unclear 


5. Highly unlikely 



Clarity 


Objective 


Achievability 




To develop a catalog of area natural resources 






To help girls develop a better self-image 






To improve classroom instruction through multi- 
instructional media 






To provide leadership training for administrators 






To make modern craft equipment and artist- 
consultants available to students talented in 
crafts 






To publish a periodical with the works of students 
of a region pertaining to literature, drama, and 
art 






To develop self-directed learning habits in 
students 






To formulate and implement special curricular 
programs for students diagnosed as having learning 
disabilities 






To prepare low achievers for entry into service -type 
occupations 






To recruit, train, and employ impoverished people as 
paraprofessionals in the schools 
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Exerclse 7 



Rank the following project objectives in terms of the Regents 
priorities of needs: (Use 1 = highest priority) (Tables 4 and 5) 



Objective Rank 



1. To invent new programs in childhood education 



2. To increase children's ability to learn 

— ■ > - * 



3. To mix Negra,a;id white, children of all economic levels 



4. To encourag'd* bthatlve"' teachers to be innovative 



5. To train teacher aides and parents to wotk with young 
children 



6. To provide practical experience for preprofessional 
trainees 



7. To provide facilities for the conduct of research 
projects 



8. To coordinate health and educational services from 
birth to lower elementary grades 
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Exerclse ^ 

Rewrite In behavioral terms, any 10 of the educational objectives 
proposed by the bureaus of the State Education Department (Table 8). 



Original 



Revision 



ERIC Clearinghouse 

JUL 91970 

on Adult Education | 

I 
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